Terahertz wave camera system and method for controlling terahertz wave camera system

ABSTRACT

A system includes a first transmission unit configure to emit a first terahertz wave, a second transmission unit disposed at a position different from a position of the first transmission unit and configured to emit a second terahertz wave, a detection unit for detecting at least one of a first reflected terahertz wave that is a part of the first terahertz wave reflected from an object, or a second reflected terahertz wave that is a part of the second terahertz wave reflected from the object, and outputting image data based on the detected terahertz wave, and a first control unit configured to, under a condition set based on the image data, control at least one of an operation of the first transmission unit or an operation of the second transmission unit.

BACKGROUND OF THE DISCLOSURE Field of the Disclosure

The aspect of the embodiments relates to a terahertz wave camera system.

Description of the Related Art

Terahertz wave is typically a radio wave having any frequency band inthe range from 0.2 THz to 30 THz. The terahertz wave has a longerwavelength than those of visible light and infrared light, therefore isunlikely to be influenced by a scattering from an object, and has hightransmission properties through many substances. The terahertz wave hasa shorter wavelength than that of a millimeter wave and thereforeenables high spatial resolution to be obtained. Making use of thesefeatures, the terahertz wave is expected to be applied to a safe imagingtechnique to replace an X-ray technique. For example, the terahertz waveis expected to be applied to a concealed object inspection technique,such as those used in a security check or a monitoring camera in apublic place.

Japanese Patent Application Laid-Open No. 2018-87725 discusses a camerasystem to which a terahertz wave is applied. Japanese Patent ApplicationLaid-Open No. 2018-87725 discusses a method for, in an active terahertzwave camera system, causing a plurality of terahertz wave light sourcesto generate terahertz waves, emitting the terahertz waves to an object,and detecting terahertz waves reflected from the object.

SUMMARY OF THE DISCLOSURE

One of aspects of the disclosure provides a system comprising: a firsttransmission unit configured to emit a first terahertz wave; a secondtransmission unit disposed at a position different from a position ofthe first transmission unit and configured to emit a second terahertzwave; a detection unit for detecting at least one of a first reflectedterahertz wave that is a part of the first terahertz wave reflected froman object, or a second reflected terahertz wave that is a part of thesecond terahertz wave reflected from the object, and outputting imagedata based on the detected terahertz wave; and a first control unitconfigured to, under a condition set based on the image data, control atleast one of an operation of the first transmission unit or an operationof the second transmission unit.

Further features of the present disclosure will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating a configuration of a terahertz wavecamera system according to a first exemplary embodiment.

FIGS. 2A and 2B are each a diagram illustrating an example of aconfiguration of a transmission unit according to the first exemplaryembodiment.

FIGS. 3A and 3B are each a diagram illustrating an example of aconfiguration of a transmission unit according to a second exemplaryembodiment.

FIG. 4 is a diagram illustrating a configuration of a terahertz wavecamera system according to a third exemplary embodiment.

FIG. 5 is a flowchart illustrating an operation flow of the terahertzwave camera system according to the first exemplary embodiment.

FIGS. 6A and 6B are image diagrams illustrating a terahertz imageacquired by the terahertz wave camera system according to the firstexemplary embodiment.

FIG. 7 is a flowchart illustrating an operation flow of the terahertzwave camera system according to the third exemplary embodiment.

FIG. 8 is a diagram illustrating a configuration of a terahertz wavecamera system according to a fourth exemplary embodiment.

FIGS. 9A, 9B, and 9C are each a diagram illustrating an example of aconfiguration of an image processing unit.

FIG. 10A is an image diagram illustrating the terahertz wave camerasystem according to each of the first and third exemplary embodiments.FIG. 10B is a schematic diagram illustrating the terahertz wave camerasystem according to the first exemplary embodiment. FIG. 10C is adiagram illustrating terahertz waves.

FIG. 11 is a schematic diagram illustrating the terahertz wave camerasystem according to the third exemplary embodiment.

FIG. 12A is a flowchart illustrating an operation flow of the terahertzwave camera system according to the first exemplary embodiment. FIG. 12Bis a table illustrating conditions.

FIG. 13 is a flowchart illustrating an operation flow of the terahertzwave camera system according to the first exemplary embodiment.

FIGS. 14A and 14B are diagrams illustrating a learning model accordingto a fifth exemplary embodiment.

FIG. 15 is a flowchart illustrating an operation flow of a terahertzwave camera system according to a sixth exemplary embodiment.

DESCRIPTION OF THE EMBODIMENTS

Exemplary embodiments will be described in detail below with referenceto the accompanying drawings. The following exemplary embodiments arenot intended to limit the present disclosure. Although a plurality offeatures is described in the exemplary embodiments, not all theplurality of features is essential for the disclosure, and the pluralityof features may be optionally combined together. Further, in theaccompanying drawings, the same or similar components are designated bythe same reference numbers, and are not redundantly described.

First, a terahertz wave will be described. Typically, the terahertz waveis a radio wave having any frequency band in the range from 0.2 THz to30 THz. The terahertz wave has a longer wavelength than those of visiblelight and infrared light, therefore is unlikely to be influenced by ascattering from an object, and thus, has high transmission propertiesthrough many substances. The terahertz wave has a shorter wavelengththan that of a millimeter wave and therefore enables high spatialresolution to be obtained. Making use of these features, the terahertzwave is expected to be applied to a safe imaging technique to replace anX-ray technique. Specifically, the imaging technique to which theterahertz wave is expected to be applied is a security check or amonitoring camera in a public place. A description will be given belowof a terahertz wave camera system applicable to the security check orthe monitoring camera to which the terahertz wave is expected to beapplied.

When an object having a concealed object under a covering object iscaptured using an active terahertz wave camera system, a part of anemitted terahertz wave may be reflected from the covering object. As aresult, an image can be obtained in which information based on aterahertz wave reflected from an unwanted interface, i.e., noise, issuperimposed on information regarding the concealed object.

The surface of the object has a complicated shape and differs withrespect to each object. In other words, the object has a combination ofa plurality of reflective surfaces. Thus, with respect to eachreflective surface of the object, the positional relationship between anillumination unit serving as a light source for the reflective surfacesand a detection unit may change. In a case where the object moves, theorientation of the object changes moment by moment, and therefore,according to the change in the orientation, the positional relationshipbetween the illumination unit serving as the light source for thereflective surfaces forming the object and the detection unit may changemoment by moment. Due to such a change in the positional relationship,an unwanted reflected terahertz wave among terahertz waves reflectedfrom the object may be incident, and an image having a large amount ofnoise may be obtained.

First Exemplary Embodiment

FIG. 1 is a diagram illustrating the configuration of a terahertz wavecamera system 100 according to a first exemplary embodiment. Theterahertz wave camera system 100 includes at least an illumination unit101, a detection unit 102, a control unit 103, and an image processingunit 105. The terahertz wave camera system 100 may include a visiblecamera 109. The illumination unit 101 emits terahertz waves to an object106. The detection unit 102 detects terahertz waves reflected from theobject 106. The terahertz wave camera system 100 is an active camerasystem.

The object 106 is, for example, a person or a physical body. The object106 according to the present exemplary embodiment has at least aconcealed object 106 a and a covering object 106 b. The covering object106 b covers a physical body. For example, the covering object 106 b isa thing that a person wears, such as clothes or a wearable object, i.e.,the thing that covers a person. For example, the covering object 106 bis a thing that covers a physical body, such as corrugated fiberboard,an envelope, or a packaging material. The concealed object 106 a is aphysical body covered by the covering object 106 b. Examples of theconcealed object 106 a include a dangerous article, such as a firearm oran explosive, an accessory or jewelry, or a small apparatus, such as asmartphone. An example of the concealed object 106 a is one to becontained inside the covering object 106 b. In the present exemplaryembodiment, the object 106 is a person and is in a state where theobject 106 hides the concealed object 106 a such as a gun or a knifeunder the covering object 106 b which is clothes. Examples of the object106, however, are not limited to this, and can include a piece of mailin which the concealed object 106 a as a weapon or an explosive ishidden in the covering object 106 b which is a packing material, such ascorrugated fiberboard or an envelope.

The illumination unit 101 includes at least a transmission unit 101 aand a transmission unit 101 b disposed at a position different from thatof the transmission unit 101 a. The transmission unit 101 a emits aterahertz wave 107 a, and the transmission unit 101 b emits a terahertzwave 107 b. FIG. 1 illustrates an example where the illumination unit101 includes transmission units 101 c and 101 d in addition to thetransmission units 101 a and 101 b. The number of transmission unitsincluded in the illumination unit 101 is not limited to this, and asingle transmission unit or a plurality of transmission units may beincluded. The configurations of the transmission unit 101 a and the likewill be described in detail below. The terahertz waves 107 a and 107 bare emitted to the object 106.

Typically, the band of a terahertz wave used by the illumination unit101 falls within the range from 0.2 THz to 30 THz. The band of theterahertz wave may have any frequency band, or may be a singlefrequency. A terahertz wave of 1 THz or less has sufficiently hightransmission properties through clothes, which is a conceivable coveringobject 106 b. To obtain the resolution of an image that enables theidentification of the shape of the concealed object 106 a, it isdesirable to use a terahertz wave of 0.3 THz or more. Thus, the band ofthe terahertz wave according to the present exemplary embodiment is inthe frequency range of 0.2 THz or more and 30 THz or less, preferably0.3 THz or more and 1 THz or less.

The detection unit 102 is a terahertz wave camera that acquires thetwo-dimensional distribution of a reflected terahertz wave from theobject 106. The details of the configuration of the detection unit 102are discussed in Japanese Patent Application Laid-Open No. 2019-105622.The detection unit 102 includes a reception unit 102 a that receives aterahertz wave. For example, the reception unit 102 a includes aplurality of reception elements, and each of the plurality of receptionelements has sensitivity to a terahertz wave. For example, the receptionelement includes a Schottky barrier diode and an antenna.

The detection unit 102 detects at least one of reflected terahertz waves108 a or 108 b, and outputs the reflected terahertz wave as image data.The reflected terahertz wave 108 a includes at least a part of theterahertz wave 107 a reflected from the object 106. The reflectedterahertz wave 108 b includes at least a part of the terahertz wave 107b reflected from the object 106. The reflected terahertz wave 108 a canbe a reflected wave from the concealed object 106 a of the object 106,and the reflected terahertz wave 108 b can be a reflected wave from thecovering object 106 b of the object 106. The reception unit 102 aaccording to the present exemplary embodiment can mainly receive anddetect the reflected terahertz wave 108 a.

The image processing unit 105 processes the image data output from thedetection unit 102, thus generating a terahertz image. The imageprocessing unit 105 makes a desired determination based on the generatedterahertz image, and outputs a determination result to the control unit103. Specifically, the image processing unit 105 includes a centralprocessing unit (CPU) and a graphics processing unit (GPU).

The control unit 103 controls the operations of the illumination unit101 and the detection unit 102. Further, the control unit 103 controlsthe operation of the illumination unit 101 based on the terahertz imageor the determination result sent from the image processing unit 105.More specifically, the control unit 103 controls the transmission units101 a to 101 d to change the terahertz wave 107 a, the terahertz wave107 b, a terahertz wave 107 c, and a terahertz wave 107 d, respectively.

Referring now to FIGS. 10A to 10C, the terahertz wave camera system 100according to the present exemplary embodiment will be described. Asdescribed above, for a security check and a monitoring camera there isdemand for an object to be captured and whether or not the objectincludes a concealed object (e.g., a dangerous article, such as afirearm or an explosive, an accessory or jewelry, or a small apparatus,such as a smartphone) under a covering object (e.g., clothes or packing)to be checked. The present inventors have found that an image acquiredby a terahertz wave camera system is an image in which images based on aplurality of reflected terahertz waves are superimposed on each otherthrough a detailed study.

An electromagnetic wave including a terahertz wave has the followingproperties. If the electromagnetic wave is emitted to an unevenstructure equal to or smaller than the wavelength of the electromagneticwave, the electromagnetic wave is not scattered on the surface of theuneven structure, and is specularly reflected from the surface of theuneven structure. In other words, for a certain electromagnetic wave, anuneven structure smaller than the wavelength of the electromagnetic wavecan be a specular surface. For example, the uneven structure of the skinsurface of a human body and the uneven structure of a metal surface aresmaller than the wavelength of the terahertz wave. Thus, for theterahertz wave, the skin surface of a person or a metal surface can be aspecular surface. A part of the terahertz wave is transmitted through afabric material used for clothes or a packing material, such ascorrugated fiberboard or an envelope, and a part of the terahertz waveis reflected from the fabric material or the packaging material. Thus,in a case where a person who conceals a physical body under clothes as acovering object is observed using the terahertz wave, an image based ona reflected terahertz wave from the clothes, an image based on areflected terahertz wave from the physical body, and an image based on areflected terahertz wave from the person are superimposed on each other.

FIG. 10A is an image diagram illustrating the state where a plurality ofterahertz wave reflected images is superimposed on each other, and fordescribing the present exemplary embodiment. An object 1092 is a personwho has a physical body (e.g., a concealed object 1094) therewith undera covering object 1093. In this case, an image 1091 is obtained as aterahertz image. The image 1091 is an image in which an image derivedfrom the covering object 1093, an image derived from the concealedobject 1094, and an image derived from the skin surface of the personare superimposed on each other. If attention is paid to the concealedobject 1094, images other than the image of the concealed object 1094are superimposed on the image of the concealed object 1094, andtherefore, it may be difficult to identify the concealed object 1094.

FIG. 10B is a schematic diagram illustrating superimposition of aplurality of terahertz wave reflected images, and for describing thepresent exemplary embodiment. FIG. 10B schematically illustrates theobject 1092 illustrated in FIG. 10A and a main part of the terahertzwave camera system 100 illustrated in FIG. 1. With reference to FIG.10B, a description will be given of an example of a case where reflectedimages are superimposed on each other.

As illustrated in FIG. 10A, the object 1092 has therewith the concealedobject 1094 and the covering object 1093. In an X-direction, thecovering object 1093 is located between the concealed object 1094 andthe transmission units 101 a and 101 b. FIG. 10B illustrates thedirectional axes of terahertz waves. The directional axes of theterahertz waves will be described below.

The transmission unit 101 a emits a terahertz wave 117 a, and thetransmission unit 101 b emits a terahertz wave 117 b. Much of theterahertz wave 117 a is transmitted through the covering object 1093 andreflected from a surface 1094 a of the concealed object 1094. Theterahertz wave 117 a becomes a reflected terahertz wave 118 a, and thereflected terahertz wave 118 a is detected by the reception unit 102 a.Much of the terahertz wave 117 b is reflected from a surface 1093 a ofthe covering object 1093. The terahertz wave 117 b becomes a reflectedterahertz wave 118 b, and the reflected terahertz wave 118 b is detectedby the reception unit 102 a. Each of the terahertz waves 117 a and 117 bis not limited to a terahertz wave all of which is reflected andtransmitted, and a part of the terahertz wave may be reflected andtransmitted. A part of each of the terahertz waves 117 a and 117 b mayattenuate, or may be absorbed. The terahertz wave detected by thereception unit 102 a is the sum of the reflected terahertz waves 118 aand 118 b and includes information regarding the covering object 1093and the concealed object 1094. Thus, the image 1091 as illustrated inFIG. 10A is acquired. A part of the terahertz wave 117 a is reflectedfrom the surface 1093 a of the covering object 1093 and becomes areflected terahertz wave 119 a, but the reflected terahertz wave 119 ais not incident on the reception unit 102 a, and thus a descriptionthereof is omitted.

To acquire an image of the concealed object 1094, only the reflectedterahertz wave 118 a is detected. That is, the image 1091 includesinformation as a noise such as the covering object 1093 and is anunclear image. In response, in the terahertz wave camera system 100according to the present exemplary embodiment illustrated in FIG. 1, thecontrol unit 103 performs control to make the output of the transmissionunit 101 b smaller than the output of the transmission unit 101 a or tostop the transmission unit 101 b. Such control enables reduction of thereflected terahertz wave 108 b, which becomes noise.

The terahertz wave camera system 100 according to the present exemplaryembodiment has a configuration including a plurality of transmissionunits disposed at different positions, a single reception unit, and acontrol unit. Alternatively, the configuration includes a singletransmission unit, a plurality of reception units disposed at differentpositions, and a control unit. Yet alternatively, the configurationincludes a plurality of reception units disposed at different positions,a plurality of transmission units disposed at different positions, and acontrol unit. With such a configuration of the terahertz wave camerasystem 100, it is possible to reduce the reflected terahertz wave 108 bwhich becomes noise. Thus, the camera system 100 can obtain an image inwhich images superimposed on each other are reduced and noise isreduced.

FIG. 10C illustrates a beam pattern (the emission pattern) of theterahertz wave emitted from each of the four transmission units 101 a to101 d illustrated in FIG. 1. As illustrated in FIG. 1, the transmissionunit 101 a emits the terahertz wave 107 a, and the transmission unit 101b emits the terahertz wave 107 b. The transmission unit 101 c emits theterahertz wave 107 c, and the transmission unit 101 d emits theterahertz wave 107 d. The directional axes of the terahertz waves 107 ato 107 d are indicated by terahertz waves 117 a to 117 d, respectively.As described above, the terahertz waves 117 a and 117 b illustrated inFIG. 10B indicate directional axes. A directional axis is the centralaxis of the directional characteristics of a terahertz wave from atransmission unit. For example, the directional axis is a straight lineindicating the direction in which the terahertz wave having the highestintensity is emitted from the transmission unit. For example, thedirectional axis can be obtained as follows. A plurality of concentricspheres centered at the center of gravity of the transmission unit andhaving different radii is created. The position at which the terahertzwave has high intensity is determined for each spherical surface, andthese positions are connected together. Thus, the directional axis canbe obtained. The directional axis can also be obtained by simulation.Although the terahertz waves in FIG. 10B are indicated by directionalaxes, the terahertz waves in FIG. 10B are electromagnetic waves havingspreads as illustrated in FIG. 10C.

Referring back to FIG. 1, the operation of the control unit 103according to the present exemplary embodiment will be described indetail. The control unit 103 controls the operation of the illuminationunit 101. According to a control signal from the control unit 103, thetransmission units 101 a to 101 d of the illumination unit 101 canchange the outputs and the operations of the transmission units 101 a to101 d. Next, the control of the control unit 103 will be described indetail. To facilitate understanding, the following description will begiven based on the assumption that the control unit 103 controls the twotransmission units 101 a and 101 b. However, the number of transmissionunits that can be controlled by the control unit 103 is not limited tothis.

The control unit 103 can perform at least the following three types ofcontrol. The control unit 103 can perform control for causing thetransmission unit 101 a to operate and stopping the transmission unit101 b. The control unit 103 brings the transmission unit 101 a into astate where the transmission unit 101 a emits the terahertz wave 107 a.The control unit 103 brings the transmission unit 101 b into a statewhere the transmission unit 101 b does not emit the terahertz wave 107b. It can be said that the control unit 103 can perform control forbringing the transmission unit 101 a into an emission state and bringingthe transmission unit 101 b into a non-emission state. The control unit103 can perform control for stopping the transmission unit 101 a andcausing the transmission unit 101 b to operate. The control unit 103brings the transmission unit 101 a into a state where the transmissionunit 101 a does not emit the terahertz wave 107 a. The control unit 103brings the transmission unit 101 b into the state where the transmissionunit 101 b emits the terahertz wave 107 b. It can be said that thecontrol unit 103 can perform control for bringing the transmission unit101 a into a non-emission state and bringing the transmission unit 101 binto an emission state. That is, the control unit 103 can performcontrol for switching the presence or absence of the output of theillumination unit 101. Hereinafter, an operating state will also bereferred to as an “on state”, and a stopped state will also be referredto as an “off state”.

The operating or emission state is the state where the transmission unitemits the terahertz wave. The stopped or non-emission state is the statewhere the transmission unit does not emit the terahertz wave. If thetransmission unit 101 b is in the non-emission state, for example, thesupply of a power supply voltage to the transmission unit 101 b may bestopped. If the transmission unit 101 b is in the non-emission state, aswitch for controlling whether to emit the terahertz wave 107 b from thetransmission unit 101 b may be turned off. Alternatively, a blockingobject such as a shutter for blocking the terahertz wave 107 b if thetransmission unit 101 b is in the non-emission state may be provided inthe directional axis direction of the transmission unit 101 b.

The control unit 103 can further perform control for adjusting theoutput of the illumination unit 101. The illumination unit 101 includesa transmission element that transmits a terahertz wave, and the outputof the illumination unit 101 can be adjusted by changing the operatingpoint of the voltage or the current of the transmission element.Alternatively, if the illumination unit 101 includes a plurality oftransmission elements, the output of the illumination unit 101 can beadjusted by controlling the number of transmission elements to beoperated. A change in the output can be checked using a detectionapparatus capable of detecting a terahertz wave, or using the detectionunit 102 of the camera system 100. A change in the output can also bechecked by a method for monitoring the operating point of theillumination unit 101.

For example, the control unit 103 can perform control for making theoutput of the transmission unit 101 a stronger than the output of thetransmission unit 101 b. The control unit 103 can perform control formaking the output of the transmission unit 101 a weaker than the outputof the transmission unit 101 b. The control unit 103 can perform controlto make the output of the transmission unit 101 a equal to the output ofthe transmission unit 101 b.

The control unit 103 can perform control for reducing the differencebetween the output of the transmission unit 101 a and the output of thetransmission unit 101 b. The control unit 103 can perform control forincreasing the difference between the output of the transmission unit101 a and the output of the transmission unit 101 b. The control unit103 can perform control for keeping constant the difference between theoutput of the transmission unit 101 a and the output of the transmissionunit 101 b and also change the output of the transmission unit 101 a andthe output of the transmission unit 101 b.

As described above, the number of transmission units that can becontrolled by the control unit 103 is not limited to this description.In other words, among a plurality of transmission units, the controlunit 103 can cause a particular transmission unit to operate, stop theparticular transmission unit, and switch the output of the particulartransmission unit. Among a plurality of transmission units, the controlunit 103 can cause a transmission unit belonging to a particular groupto operate, stop the transmission unit belonging to the particulargroup, and switch the output of the transmission unit belonging to theparticular group. The control unit 103 thus controls the operation ofthe illumination unit 101, reducing an unwanted reflected terahertzwave. Thus, it is possible to acquire an image in which noise isreduced.

The control unit 103 performs such control of the illumination unit 101based on information output from the image processing unit 105. Next,the operation of the image processing unit 105 will be described.

The image processing unit 105 generates a terahertz image based on imagedata output from the detection unit 102. The image processing unit 105determines the shape or the type of the object 106 based on theterahertz image. As illustrated in FIG. 1, the terahertz wave camerasystem 100 may include the visible camera 109, and the image processingunit 105 may contrast the terahertz image with a visible image from thevisible camera 109 to determine the shape of the object 106. The visibleimage (e.g., a visible image 944 illustrated in FIGS. 9A to 9C) includesshape information. With reference to this determination result, thecontrol unit 103 controls the illumination unit 101. With reference toFIGS. 9A to 9C, the configuration of the image processing unit 105 willbe described.

FIG. 9A is a diagram illustrating an example of the configuration of theimage processing unit 105. The image processing unit 105 according tothe present exemplary embodiment includes an image generation unit 942and a determination unit 945. The image generation unit 942 convertsimage data 941 output from the detection unit 102 into a terahertz image943. The image data 941 is unprocessed image data. The unprocessed imagedata is data output from an image sensor of the detection unit 102without change, and is also termed “raw data”. The terahertz image 943is data obtained by converting the image data 941 into a recordingformat suitable for post-processing. The determination unit 945determines a target that is being observed by the detection unit 102with reference to the terahertz image 943. In the present exemplaryembodiment, the terahertz image 943 having been subjected to thepost-processing is used in the determination. Alternatively, thedetermination can also be made using the image data 941. Hereinafter,the determination including also a case where the terahertz image isused will occasionally be referred to as “making the determination basedon the image data”.

In the determination, the entire or partial matching or the correlationbetween a visible image 944 of the covering object 106 b (see FIG. 1)from the visible camera 109 and the terahertz image 943 is calculated,for example. The determination unit 945 determines which of pieces ofinformation regarding the concealed object 106 a and the covering object106 b has a larger amount, and which of the concealed object 106 a andthe covering object 106 b is being observed. The image processing unit105 passes a determination result 946 to the control unit 103. Thecontrol unit 103 checks whether the specifying of a physical body to beobserved and the determination result 946 match. If the specifying andthe determination result 946 do not match, the control unit 103 controlsthe illumination unit 101.

FIG. 9B is a diagram illustrating another example of the configurationof the image processing unit 105. The image processing unit 105 includesthe image generation unit 942, the determination unit 945, and adatabase 947. That is, the image processing unit 105 in FIG. 9B includesthe database 947 in addition to the configuration of the imageprocessing unit 105 in FIG. 9A. In the configuration of FIG. 9B, thevisible camera 109 can also be omitted.

The database 947 is stored in, for example, a memory space in anapparatus, a server on a network, or a storage medium. The database 947stores model image information including shape data about the object106. Specifically, the database 947 stores a terahertz image of theobject 106 acquired in advance and the condition of the terahertz image.The database 947 stores information obtained by processing the terahertzimage (an edge enhancement image). In the configuration of FIG. 9B, thedetermination unit 945 makes a determination using the terahertz imagestored in the database 947 and the terahertz image 943 acquired by thedetection unit 102. Since a visible image is an external appearanceimage of the object 106, the visible image 944 mainly includesinformation regarding the covering object 106 b. Thus, in a case where adetermination is made using the visible image 944 and the terahertzimage 943, it can be determined whether an image represented by theterahertz image 943 is the covering object 106 b. In a case where adetermination is made using the terahertz image in the database 947 andthe terahertz image 943, it can be determined whether an imagerepresented by the terahertz image 943 is the concealed object 106 a.Alternatively, the database 947 may have a visible image. In this case,it is easy to omit the visible camera 109. Information stored in thedatabase 947 is not limited to shape information. For example, thedatabase 947 may store a classification filter based on statisticalprocessing for use in a determination, which is created in advance, atrained machine learning model for use in a determination, and a datagroup (a data set) for use in machine learning. In the present exemplaryembodiment, these pieces of information stored in the database 947 arealso referred to as “shape data”.

FIG. 9C is a diagram illustrating another example of the configurationof the image processing unit 105. The image processing unit 105 in FIG.9C includes artificial intelligence (AI). The image processing unit 105includes the image generation unit 942, the database 947, and an AI unit948. Specifically, the AI unit 948 of the image processing unit 105 inFIG. 9C replaces the determination unit 945 of the image processing unit105 in FIG. 9B.

The AI unit 948 has a trained machine learning model. For example, thetrained machine learning model is constructed based on a data setregarding image information including shape information stored in thedatabase 947. Using the trained machine learning model, the imageprocessing unit 105 can determine whether the terahertz image 943 is theconcealed object 106 a or the covering object 106 b. The AI unit 948 mayhave a deep learning function. Typically, a machine learning modelrequires supervised data with which an operator indicates a feature topay attention to. The AI unit 948, however, has the deep learningfunction so that a feature can be automatically extracted. The AI unit948 has the deep learning function, so that the determination accuracyof the image processing unit 105 improves according to an increase inthe number of data sets.

In particular, the use of the deep learning function is suitable forlearning the terahertz image 943. The visible image 944 is obtained bythe visible camera 109 detecting and imaging scattered light from theobject 106. By contrast, the terahertz image 943 is obtained by imagingspecularly reflected light from the object 106 detected by the detectionunit 102. The terahertz image 943 is obtained by imaging a reflectedterahertz wave that has reached the detection unit 102, so that thefragmentary shape of the object 106 is imaged. The optical path of thespecularly reflected light before reaching the detection unit 102changes according to the orientation of the object 106. Thus, the imageof the fragmentary shape changes according to the orientation of theobject 106. The determination using the deep learning function is usefulfor estimating and determining the object 106 from fragmentaryinformation.

Referring now to FIG. 12A, in step S1201, an image capturing conditionis set initially. The image capturing condition is the control sequenceof the illumination unit 101 or the detection unit 102. Herein, theimage capturing condition includes at least conditions 1231, 1232, and1233 illustrated in FIG. 12B. Under the condition 1231, the transmissionunit 101 a is caused to operate, and the transmission unit 101 b isstopped. Under the condition 1232, the transmission unit 101 a isstopped, and the transmission unit 101 b is caused to operate. Under thecondition 1233, the output of the transmission unit 101 a is increased,and the output of the transmission unit 101 b is decreased. Under acondition, after the transmission unit 101 a is caused to operate, thetransmission unit 101 a may be stopped, and the transmission unit 101 bmay be caused to operate. Another condition may be provided in advance,but the amount of change in the condition can also be appropriately setby the image processing unit 105. In this case, in step S1201, the imagecapturing condition is set by selecting the condition 1231.

Next, an image is captured under the image capturing condition based onthe condition 1231. In step S1202, image data is acquired. Based on theimage data, a terahertz image is generated. In step S1203, a desireddetermination is made, such as determining whether information includedin the terahertz image mainly includes information based on the coveringobject 106 b, or whether the terahertz image includes the concealedobject 106 a that matches shape data. Here, using shape data 1210, it isdetermined whether the terahertz image includes the concealed object 106a that matches the shape data 1210. In the determination in step S1203,if the terahertz image does not include the concealed object 106 a thatmatches the shape data 1210 (NO in step S1203), the operation returns tostep S1201. In step S1201, another condition, for example, the condition1232, is selected as the image capturing condition, and image data isacquired again. In the determination in step S1203, if the terahertzimage mainly includes information regarding the concealed object 106 athat matches the shape data 1210, the capturing of the image ends. Animage capturing condition for reducing noise can be specified, andtherefore, it is possible to acquire an image with reduced noise.

Next, in the determination in step S1303, if the terahertz image mainlyincludes information regarding the concealed object 106 a that matchesshape data 1332 (YES in step S1303), the processing proceeds to stepS1304. In step S1304, the image capturing condition for the terahertzimage used in the determination is recorded. This record can be held asa condition 1333. The condition 1333 can also be said to be an actualimage capturing condition.

Next, in step S1305 in a period 1313, an image capturing condition isset. The condition 1333 is selected as the image capturing condition. Ifthe image capturing condition does not change, the image capturingcondition is not changed. In step S1306, image data is acquired. Such aprocess enables the acquisition of image data with reduced noise.

When the terahertz wave camera system 100 is installed, the operation inperiods 1311 and 1312 may be performed, then in a subsequent normaloperation, the operation in the period 1313 may be performed.Alternatively, the operation in the periods 1311 to 1313 may be repeatedin a normal operation.

Next, FIG. 5 is a flowchart illustrating a detailed operation of theterahertz wave camera system 100 according to the present exemplaryembodiment. Here, an example of an operation for observing the concealedobject 106 a will be described. The flow in FIG. 5 corresponds to theflow in FIG. 13.

The operation flow in this example includes at least periods 531, 532,and 533. That is, the operation includes step S501 in the period 531,step S504 in the period 532, and step S509 in the period 533. Every timeeach of steps S501, S504, and S509 is performed, the operation of theapparatus switches.

The operation mode of the terahertz wave camera system 100 in the period531 is an image capturing condition adjustment mode. In the period 531,the control unit 103 sets the image capturing condition of theillumination unit 101 and the detection unit 102 to a predeterminedcondition in accordance with the control sequence of the apparatusdescribed below.

The operation mode of the terahertz wave camera system 100 in the period532 is an object determination processing mode. In the period 532, theimage processing unit 105 makes a determination based on an image of theobject 106 captured under the image capturing condition set in theperiod 531. In the period 532, based on the determination result, theimage processing unit 105 determines an image capturing condition (alsoreferred to as an “actual image capturing condition”) under which theactual image capturing of the terahertz wave camera system 100 will beperformed.

The operation mode of the terahertz wave camera system 100 in the period533 is an actual image capturing mode. In the period 533, the controlunit 103 performs control to perform the actual image capturing of theobject 106 under the image capturing conditions determined in theperiods 531 and 532. For example, at least the operations from step S501to step S502 may be performed in the standby period of the terahertzwave camera system 100, and at least step S509 may be performed in theimage capturing period of the terahertz wave camera system 100. That is,the standby period of the terahertz wave camera system 100 may beoverlapped with the periods 531 and 532, and the image capturing periodof the terahertz wave camera system 100 may be overlapped with theperiod 533.

The detailed flow will be described below. If the operation of theterahertz wave camera system 100 starts, then in step S501, theoperation proceeds to the period 531. In the period 531, in step S502,based on the control sequence under a condition 534, the control unit103 controls the components of the terahertz wave camera system 100. Thecontrol unit 103 controls the illumination unit 101. The control unit103 controls the terahertz wave 107 a emitted from the transmission unit101 a and the terahertz wave 107 b emitted from the transmission unit101 b. Here, an example is described where the control unit 103 controlsthe transmission units 101 a and 101 b and controls the terahertz waves107 a and 107 b emitted from the transmission units 101 a and 101 b,respectively. The control targets of the control unit 103, however, arenot limited to these. The control unit 103 may control only the singletransmission unit 101 a. For example, the control unit 103 according tothe present exemplary embodiment may further control the transmissionunits 101 c and 101 d and control the terahertz waves 107 c and 107 demitted from the transmission units 101 c and 101 d, respectively. Inthe control sequence under the condition 534, a plurality of imagecapturing conditions and the order of carrying out the image capturingconditions are stored. Based on the image capturing condition for thecontrol sequence, the control unit 103 in FIG. 1 controls terahertzwaves emitted from the illumination unit 101. For example, in thecontrol sequence under the condition 534, the combinations, the power,and the order of the terahertz waves 107 a to 107 d emitted from thetransmission units 101 a to 101 d, respectively, are stored.

In the period 531, in step S503, the detection unit 102 measures theterahertz waves 108 a and 108 b. The terahertz wave camera system 100acquires image data 535 output from the detection unit 102. The imageprocessing unit 105 converts the image data 535 into the terahertz image943 illustrated in FIGS. 9A to 9C.

After the image data 535 is acquired, then in step S504, the operationproceeds to the period 532. In the period 532, based on the acquiredimage data 535, an image capturing condition (an actual image capturingcondition) to be applied in the period 533 to which the operation willproceed is determined. The image capturing condition to be used in thisactual image capturing is referred to as a “condition 537”. In thecondition 537, control information regarding the terahertz wave 107 a ofthe transmission unit 101 a and control information regarding theterahertz wave 107 b of the transmission unit 101 b that are to be usedin the period 533 are recorded. Further, in the present exemplaryembodiment, in the condition 537, control information regarding theterahertz waves 107 c and 107 d emitted from the transmission units 101c and 101 d, respectively, is also recorded. The image capturingcondition recorded as the condition 537 according to the presentexemplary embodiment and to be used in the actual image capturingincludes the selection, from the emission states and the non-emissionstates, of the operations of the terahertz waves 107 a, 107 b, 107 c,and 107 d generated from the transmission units 101 a, 101 b, 101 c, and101 d, respectively. The condition 537 is determined by the imageprocessing unit 105 based on the determination of the image processingunit 105 described below. The detailed operation flow in the period 532will be described below.

In step S505, the image processing unit 105 extracts a similarity or acorrelation. Specifically, the image processing unit 105 extracts atleast one of the similarity or the correlation between the terahertzimage 943 obtained from the image data 535 and shape data 536. Forexample, the shape data 536 is the visible image 944 from the visiblecamera 109. For example, the shape data 536 is the information stored inthe database 947. In the present exemplary embodiment, the imageprocessing unit 105 extracts the similarity or the correlation betweenthe object 106 and the covering object 106 b.

Next, in step S506, it is determined whether the terahertz image 943 isthe concealed object 106 a using a result of the extraction. Forexample, in the present exemplary embodiment, if information regardingthe terahertz image 943 has a low similarity to or a low correlationwith the covering object 106 b included in the shape data 536, it isdetermined that the terahertz image 943 is the concealed object 106 a.If it is determined that the terahertz image 943 is the concealed object106 a, it is determined that the object 106 includes the concealedobject 106 a. If the information regarding the terahertz image 943 has ahigh similarity to or a high correlation with the covering object 106 bincluded in the shape data 536, it is determined that the terahertzimage 943 is the covering object 106 b. The actual image capturingcondition may be stored as an image capturing condition for the coveringobject 106 b.

If it is determined that the object 106 includes the concealed object106 a (YES in step S506), then in step S507, the image capturingcondition used in the control sequence under the condition 534 isrecorded as the condition 537 (the actual image capturing condition). Inthe recording, the condition 534 can be added or updated to the actualimage capturing condition. For example, if the image capturing conditionused to determine the concealed object 106 a is not included in theactual image capturing condition as the condition 537, the condition 534is added to the condition 537. If a desired image capturing condition isalready recorded in the actual image capturing condition as thecondition 537, nothing is performed. If an image capturing conditiondifferent from a desired image capturing condition, such as an imagecapturing condition for the covering object 106 b, is recorded in theactual image capturing condition as the condition 537, this imagecapturing condition is updated and corrected. In the present exemplaryembodiment, the concealed object 106 a is determined as the object 106.Alternatively, the covering object 106 b may be determined.

In step S508, it is checked whether the control sequence under thecondition 534 ends. If the control sequence does not end (NO in stepS508), the operation returns to the period 531. If the control sequenceends (YES in step S508), then in step S509, the operation proceeds tothe actual image capturing mode in the period 533.

In the period 533, under the image capturing conditions determined inthe periods 531 and 532, the actual image capturing of the object 106 isperformed. In step S510, based on the actual image capturing condition,which is the condition 537, the control unit 103 controls the terahertzwave 107 a emitted from the transmission unit 101 a and the terahertzwave 107 b emitted from the transmission unit 101 b.

In the present exemplary embodiment, the transmission units 101 a, 101b, 101 c, and 101 d are controlled in accordance with the condition 537.For example, only a terahertz wave contributing to the observation ofthe concealed object 106 a is brought into the emission state. If theterahertz wave contributing to the observation of the concealed object106 a is the reflected terahertz wave 108 a, the control unit 103 bringsthe transmission unit 101 a into the emission state. The terahertz wave107 a is emitted to the object 106. In step S511, in this state, theterahertz wave camera system 100 acquires a terahertz image. An image iscaptured under such an image capturing condition, thus reducing anunwanted reflected terahertz wave regarding the covering object 106 b.This facilitates the acquiring of an image regarding the concealedobject 106 a in which information regarding the covering object 106 b isreduced. While not described in the present exemplary embodiment, thespecifying of the concealed object 106 a is facilitated also in a casewhere the concealed object 106 a is specified after this.

The operation of such processing enables reduction of an unwantedreflected terahertz wave. Thus, it is possible to acquire an image withreduced noise.

FIGS. 6A and 6B are image diagrams illustrating a terahertz imageacquired by the terahertz wave camera system 100 according to thepresent exemplary embodiment. A portion near the chest of the object 106is set as an observation area 641. A terahertz wave contributing to theobservation of the concealed object 106 a is brought into the emissionstate, so that a terahertz image 642 of the concealed object 106 a asillustrated in FIG. 6A is acquired. By contrast, in a case where anobservation target of the object 106 is set to the covering object 106b, the terahertz wave contributing to the observation of the concealedobject 106 a is brought into the stopped state, so that an image inwhich a terahertz image 643 of the covering object 106 b is emphasizedas illustrated in FIG. 6B is acquired. In the present exemplaryembodiment, the emission state and the stopped state of the terahertzwave are used as examples. Alternatively, the above various examples ofthe operation of the control unit 103 are applicable.

According to the configuration of the present exemplary embodiment, aterahertz image is obtained in which information other than anobservation target of interest is reduced as compared with the image1091 in which the concealed object 106 a and the covering object 106 bare conventionally superimposed on each other. This facilitatesimprovement of the ability to identify the observation target.

The transmission unit 101 a includes a housing 200. Each of a pluralityof transmission elements 211 a, 211 b, 211 c, and 211 d is installed ona supporting substrate 201 of the housing 200. The transmission unit 101a includes a control circuit 202. The control circuit 202 is provided inthe housing 200. In the present exemplary embodiment, the controlcircuit 202 is provided on one of the surfaces forming the outer shapeof the housing 200. The control circuit 202 is electrically connected tothe control unit 103, and controls the operations of the plurality oftransmission elements 211 a, 211 b, 211 c, and 211 d in accordance witha control signal from the control unit 103. It can also be said that thehousing 200 includes the plurality of transmission elements 211 a, 211b, 211 c, and 211 d and the control circuit 202.

Each of the transmission elements 211 a, 211 b, 211 c, and 211 d isobtained by disposing unit cells including elements having gains in theterahertz wave range (a transistor and a diode) and an antenna servingas an external resonant circuit in an array. An example of a useableelement having a gain include a resonant-tunneling diode (RTD). For thedetailed configuration in this case, Japanese Patent ApplicationLaid-Open No. 2014-200065 can be referenced.

The plurality of transmission elements 211 a, 211 b, 211 c, and 211 d isarranged linearly or two-dimensionally. The terahertz wave 107 a in FIG.1 is a set of terahertz waves 207 a, 207 b, 207 c, and 207 d in FIG. 2A,and the shape of the terahertz wave 107 a differs according to thearrangement of the plurality of transmission elements 211 a, 211 b, 211c, and 211 d. For example, in FIG. 1, the shape of the terahertz wave107 a on a virtual plane parallel to a plane P1 and away from the planeP1 in the emission direction is either one-dimensional ortwo-dimensional shape. Since a terahertz wave is unlikely to bescattered on the skin surface, the planar (two-dimensional) arrangementof a plurality of terahertz wave transmission elements and the emissionof terahertz waves at various angles are effective for the purpose ofcapturing the shape of an object. Thus, the arrangement of thetransmission elements is appropriately set, so that it is possible togenerate a terahertz wave having a one-dimensional or two-dimensionalbeam shape. The planar arrangement of the transmission elements enablesterahertz waves to be incident on an observation point on the object ata plurality of incident angles. As a result, a plurality of terahertzwaves different in emission angle is emitted from the observation point.This facilitates an increase in the probability that a ray of aterahertz wave from the observation point reaches a lens of a camera. Inother words, the planar arrangement of the transmission elements enablesscattered light of simulated terahertz waves to be emitted from theobservation point on the object. Such an illumination unit 101 can emitterahertz waves to the object 106 at various angles. This is effectivefor the purpose of capturing the shape of the object 106 using aterahertz wave camera.

FIG. 2B is a diagram illustrating an example of the configuration of thetransmission unit 101 b. The transmission unit 101 b includes atransmission element 311 a and a transmission element 311 b disposed ata position different from that of the transmission element 311 a. In thepresent exemplary embodiment, the transmission unit 101 b furtherincludes transmission elements 311 c and 311 d. The transmission element311 a emits a terahertz wave 307 a, the transmission element 311 b emitsa terahertz wave 307 b, the transmission element 311 c emits a terahertzwave 307 c, and the transmission element 311 d emits a terahertz wave307 d. Suppose that a plane from which the transmission elements 311 a,311 b, 311 c, and 311 d emit the terahertz waves 307 a, 307 b, 307 c,and 307 d, respectively, is defined as a plane P2. The number oftransmission elements included in the transmission unit 101 b is notlimited to this. The transmission unit 101 b includes a housing 300.Each of the transmission elements 311 a, 311 b, 311 c, and 311 d isinstalled on a supporting substrate 301 of the housing 300. Theplurality of transmission elements 311 a, 311 b, 311 c, and 311 d isconnected to the control unit 103, and the operations of the pluralityof transmission elements 311 a, 311 b, 311 c, and 311 d are controlled.The detailed configuration and arrangement of the transmission unit 101b are similar to those of the transmission unit 101 a, and thus, adescription thereof is omitted.

In the present exemplary embodiment, the process for obtaining an imageof the concealed object 106 a of the object 106 has been described.Alternatively, the covering object 106 b can also be selected as atarget object. That is, in an object including a plurality ofinterfaces, it is also possible to reduce an image based on a reflectedterahertz wave occurring on an interface other than any of theinterfaces.

In the present exemplary embodiment, it is determined whether the shapeof an object can be detected. Alternatively, it may be determinedwhether noise component greater than a prescribed value is included.Examples of the noise component include an unwanted reflected terahertzwave. The noise component can be detected by measurement in advance, andthe prescribed value can be set.

The terahertz wave camera system according to the present exemplaryembodiment enables acquisition of a terahertz image with reduced noise.

Second Exemplary Embodiment

A terahertz wave camera system according to a second exemplaryembodiment will be described with reference to FIGS. 3A and 3B. Theterahertz wave camera system according to the present exemplaryembodiment is different from the camera system 100 according to thefirst exemplary embodiment in the control targets of the control unit103. In the description of the present exemplary embodiment, portionssimilar to those in the first exemplary embodiment are not described.

FIG. 3A is a diagram illustrating an example of the configuration of thetransmission unit 101 a included in the illumination unit 101 accordingto the present exemplary embodiment. As in the transmission unit 101 aaccording to the first exemplary embodiment illustrated in FIG. 2A, thetransmission unit 101 a includes a plurality of transmission elements211 a, 211 b, 211 c, and 211 d. The transmission element 211 a emits aterahertz wave 207 a, the transmission element 211 b emits a terahertzwave 207 b, the transmission element 211 c emits a terahertz wave 207 c,and the transmission element 211 d emits a terahertz wave 207 d. Supposethat a plane from which the transmission elements 211 a, 211 b, 211 c,and 211 d emit the terahertz waves 207 a, 207 b, 207 c, and 207 d,respectively, is defined as a plane P1. The number of transmissionelements included in the transmission unit 101 a is not limited to this.

The transmission unit 101 a includes a housing 200. Each of theplurality of transmission elements 211 a, 211 b, 211 c, and 211 d isinstalled on a supporting substrate 201 of the housing 200. Unlike thetransmission unit 101 a in FIG. 2A, the transmission unit 101 a in FIG.3A does not include the control circuit 202 illustrated in FIG. 2A. Thecontrol unit 103 is electrically connected to the plurality oftransmission elements 211 a, 211 b, 211 c, and 211 d and controls theoperations of the plurality of transmission elements 211 a, 211 b, 211c, and 211 d. The operations and the detailed configurations of otherportions of the transmission unit 101 a are similar to those in FIG. 2A,and therefore are not described.

FIG. 3B is a diagram illustrating an example of the configuration of thetransmission unit 101 b included in the illumination unit 101 accordingto the present exemplary embodiment. As in the transmission unit 101 baccording to the first exemplary embodiment illustrated in FIG. 2B, thetransmission unit 101 b according to the present exemplary embodimentincludes a plurality of transmission elements 311 a, 311 b, 311 c, and311 d. The transmission element 311 a emits a terahertz wave 307 a, thetransmission element 311 b emits a terahertz wave 307 b, thetransmission element 311 c emits a terahertz wave 307 c, and thetransmission element 311 d emits a terahertz wave 307 d. Suppose that aplane from which the transmission elements 311 a, 311 b, 311 c, and 311d emit the terahertz waves 307 a, 307 b, 307 c, and 307 d, respectively,is defined as a plane P2. The number of transmission elements includedin the transmission unit 101 b is not limited to this.

The transmission unit 101 b includes a housing 300. Each of theplurality of transmission elements 311 a, 311 b, 311 c, and 311 d isinstalled on a supporting substrate 301 of the housing 300. Unlike thetransmission unit 101 b in FIG. 2B, the transmission unit 101 b in FIG.3B does not include a control circuit 302 illustrated in FIG. 2B. Thecontrol unit 103 is electrically connected to the plurality oftransmission elements 311 a, 311 b, 311 c, and 311 d and controls theoperations of the plurality of transmission elements 311 a, 311 b, 311c, and 311 d. The operations and the detailed configurations of otherportions of the transmission unit 101 b are similar to those of thetransmission unit 101 a, and thus are not described.

The control targets of the control unit 103 according to the firstexemplary embodiment are the transmission units 101 a, 101 b, 101 c, and101 d included in the illumination unit 101 (see FIG. 1). By contrast,in the present exemplary embodiment, the control unit 103 can alsocontrol the plurality of transmission elements included in thetransmission units 101 a, 101 b, 101 c, and 101 d. According to theconfiguration of the present exemplary embodiment, it is possible tocontrol a terahertz wave contributing to the observation of a desiredtarget object with more minute accuracy. Thus, the signal-to-noise ratio(SNR) of a terahertz image increases, thus facilitating improvement ofthe ability to identify the observation target. It is possible tosimplify the configuration of the illumination unit 101.

Third Exemplary Embodiment

A terahertz wave camera system 400 according to a third exemplaryembodiment will be described with reference to FIG. 4. In the presentexemplary embodiment, the terahertz wave camera system 400 is differentfrom the camera system 100 according to the first exemplary embodimentin the configuration of the detection unit 102 and the configurations ofcontrol units. In the description of the present exemplary embodiment,portions similar to those in the first exemplary embodiment are notdescribed.

FIG. 4 is a diagram illustrating the configuration of the terahertz wavecamera system 400 according to the present exemplary embodiment. Theterahertz wave camera system 400 includes at least an illumination unit101, a detection unit 102, a control unit 103, a control unit 424, andan image processing unit 105. The illumination unit 101 emits terahertzwaves to an object 106. The detection unit 102 detects terahertz wavesreflected from the object 106. The configuration of the object 106 issimilar to that in the first exemplary embodiment, and thus is notdescribed. The terahertz wave camera system 400 includes a visiblecamera 109. In addition to the configuration of the camera system 100according to the first exemplary embodiment, the terahertz wave camerasystem 400 further includes the control unit 424.

The terahertz wave camera system 400 according to the present exemplaryembodiment is different from the camera system 100 according to thefirst exemplary embodiment in the configuration of the detection unit102. The detection unit 102 includes at least a reception unit 102 a anda reception unit 102 b disposed at a position different from that of thereception unit 102 a. The reception unit 102 a detects a terahertz wave,and the reception unit 102 b receives and detects a terahertz wave. FIG.4 illustrates an example where the detection unit 102 includes receptionunits 102 c and 102 d in addition to the reception units 102 a and 102b. The number of reception units included in the detection unit 102 isnot limited to this.

As in the first exemplary embodiment, the control unit 103 controls theoperation of the illumination unit 101. The control unit 424 controlsthe operation of the detection unit 102. In the present exemplaryembodiment, the control units 103 and 424 communicate with each otherand control the operations of the illumination unit 101 and thedetection unit 102, respectively. Alternatively, the image processingunit 105 may be an entirety control unit that controls the entirety ofthe camera system 400. The control unit 424 controls the operations ofthe reception units 102 a to 102 d and controls the outputs of pieces ofimage data based on received terahertz waves.

For example, the image processing unit 105 may generate a terahertzimage from image data output from the reception unit 102 a and generatea terahertz image from image data output from the reception unit 102 b.For example, the image processing unit 105 may combine the two pieces ofimage data output from the two reception units 102 a and 102 b togenerate a single terahertz image. The detailed configuration of theimage processing unit 105 is similar to that in the first exemplaryembodiment, and the image generation unit 942 in FIG. 9A can generate aterahertz image.

Referring now to FIGS. 10A and 11, the terahertz wave camera system 400according to the present exemplary embodiment is described. FIG. 10A isan image diagram illustrating a state where a plurality of terahertzwave reflected images is superimposed on each other, and for describingthe present exemplary embodiment. FIG. 11 is a schematic diagramillustrating the state where a plurality of terahertz wave reflectedimages is superimposed on each other, and for describing the presentexemplary embodiment. FIG. 11 schematically illustrates an object 1092illustrated in FIG. 10A and the main portion of the terahertz wavecamera system 400 illustrated in FIG. 4. A description will be given ofan example of a case where reflected images are superimposed on eachother with reference to FIG. 11. Since FIG. 11 corresponds to FIG. 10Bdescribed in the first exemplary embodiment, components similar to thecomponents illustrated in FIG. 10B are designated by the same signs, andare not described.

As illustrated in FIG. 10A, the object 1092 includes a concealed object1094 and a covering object 1093. In an X-direction, the covering object1093 is located between the concealed object 1094 and the receptionunits 102 a and 102 b. FIG. 10C illustrates the directional axes ofterahertz waves. The directional axes are as described in the firstexemplary embodiment.

The transmission unit 101 a emits a terahertz wave 117 a. A part of theterahertz wave 117 a is reflected from a surface 1093 a of the coveringobject 1093, and another part of the terahertz wave 117 a is reflectedfrom a surface 1094 a of the concealed object 1094. The part of theterahertz wave 117 a becomes a reflected terahertz wave 118 a, and thereflected terahertz wave 118 a is detected by the reception unit 102 a.Another part of the terahertz wave 117 a becomes a reflected terahertzwave 118 b, and the reflected terahertz wave 118 b is detected by thereception unit 102 b. The part of the terahertz wave 117 a mayattenuate, or may be absorbed. The reflected terahertz wave 118 adetected by the reception unit 102 a includes information regarding theconcealed object 1094, and the reflected terahertz wave 118 b detectedby the reception unit 102 b includes information regarding the coveringobject 1093. If an image is generated based on the reflected terahertzwaves 118 a and 118 b detected by the two reception units 102 a and 102b, respectively, an image 1091 as illustrated in FIG. 10A is generated,in which the covering object 1093 and the concealed object 1094 aresuperimposed on each other.

To acquire an image of the concealed object 1094, it is desirable todetect the reflected terahertz wave 118 a. That is, the image 1091includes information as noise, such as the covering object 1093 and isan unclear image. In response, in the terahertz wave camera system 400according to the present exemplary embodiment illustrated in FIG. 4, thecontrol unit 424 performs control for making the output of the receptionunit 102 a greater than the output of the reception unit 102 b orstopping the reception unit 102 b. By performing such control, it ispossible to reduce the reflected terahertz wave 108 b which becomesnoise. This enables the terahertz wave camera system 400 to obtain animage in which images superimposed on each other are reduced and noiseis reduced.

Further, in the terahertz wave camera system 400 according to thepresent exemplary embodiment illustrated in FIG. 4, the control unit 103can control the operation of the illumination unit 101 as described inthe first exemplary embodiment. Thus, both the illumination unit 101 andthe detection unit 102 are controlled, so that a terahertz image withreduced noise is acquired.

The control of the control unit 424 will be described in detail. Tofacilitate understanding, the following description will be given on theassumption that the control unit 424 controls the two reception units102 a and 102 b. However, the number of reception units that can becontrolled by the control unit 424 is not limited to this.

The control unit 424 can perform at least the following three types ofcontrol. The control unit 424 can perform control for starting theoutput of image data from the reception unit 102 a and stopping theoutput of image data from the reception unit 102 b. The control unit 424can perform control for stopping the output of the image data from thereception unit 102 a and starting the output of the image data from thereception unit 102 b. The control unit 424 can perform control forstarting the output of the image data from the reception unit 102 a andthe output of the image data from the reception unit 102 b. That is, thecontrol unit 424 can perform control for switching the presence orabsence of the output of the detection unit 102.

Further, the control unit 424 can perform control for adjusting theoutput of the detection unit 102. For example, the control unit 424 canperform control for making a signal gain for image data to be outputfrom the reception unit 102 a (hereinafter, also referred to asreception-unit-102 a image data) higher than a signal gain for imagedata to be output from the reception unit 102 b (hereinafter, alsoreferred to as reception-unit-102 b image data). The control unit 424can perform control for making the signal gain for thereception-unit-102 a image data lower than the signal gain for thereception-unit-102 b image data. The control unit 424 can performcontrol for making the signal gain for the reception-unit-102 a imagedata equal to the signal gain for reception-unit-102 b image data.

The control unit 424 can perform control for reducing the differencebetween the signal gain for the reception-unit-102 a image data and thesignal gain for the reception-unit-102 b image data. The control unit424 can perform control for increasing the difference between the signalgain for the reception-unit-102 a image data and the signal gain for thereception-unit-102 b image data. The control unit 424 can performcontrol for keeping constant the difference between the signal gain forthe reception-unit-102 a image data and the signal gain for thereception-unit-102 b image data and also change the signal gains for thereception-unit-102 a image data and the reception-unit-102 b image data.The change in the gain for the output of each reception unit is made by,for example, adjusting the amplification factor of an amplificationcircuit included in a pixel circuit of the reception unit or a signalprocessing circuit of the reception unit. Alternatively, the change inthe gain of the output of the reception unit is made by adjusting theoutput of the reception unit by digitally adjusting the output of thereception unit through signal processing. The method for adjusting theoutput of the reception unit is not limited to these.

The control unit 424 performs thinning through which the operations orthe outputs of some of a plurality of reception elements included ineach reception unit is stopped, or adds signals of the plurality ofreception elements, to reduce the resolution.

As described above, the number of reception units that can be controlledby the control unit 424 is not limited to this description. That is,among a plurality of reception units, the control unit 424 can cause aparticular reception unit to operate, stop the particular receptionunit, and switch the output of the particular reception unit. Among aplurality of reception units, the control unit 424 can cause a receptionunit belonging to a particular group to operate, stop the reception unitbelonging to the particular group, and switch the output of thereception unit belonging to the particular group. The control unit 424thus controls the operation of the detection unit 102, thus reducing anunwanted reflected terahertz wave. This enables acquisition of an imagewith reduced noise.

The control unit 424 performs such control of the detection unit 102based on information output from the image processing unit 105. Next,the operation of the image processing unit 105 will be described.

As in the first exemplary embodiment, the image processing unit 105generates a terahertz image based on image information output from thedetection unit 102 and determines the shape or the type of the object106 based on the terahertz image. As in the first exemplary embodiment,the terahertz wave camera system 400 may include the visible camera 109also in the present exemplary embodiment. In such a case, the imageprocessing unit 105 can also contrast the terahertz image with a visibleimage from the visible camera 109 to determine the shape of the object106. The visible image (e.g., a visible image 944 illustrated in FIGS.9A to 9C) can also be termed “shape data”. With reference to thisdetermination result, the control unit 103 controls the operation of theillumination unit 101, and the control unit 424 controls the operationof the detection unit 102. The configuration of the image processingunit 105 is similar to that in the first exemplary embodiment, and thusis not described.

The operation of the terahertz wave camera system 400 according to thepresent exemplary embodiment will be described. FIG. 7 is a flowchartillustrating the operation flow of the terahertz wave camera system 400according to the present exemplary embodiment. Here, as in the firstexemplary embodiment, an operation flow for observing the concealedobject 106 a will be described.

The operation of the terahertz wave camera system 400 includes at leastperiods 731, 732, and 733. That is, the operation includes step S701 inthe period 731, step S704 in the period 732, and step S709 in the period733. Every time each of steps S701, S704, and S709 is performed, theoperation of the apparatus switches.

The operation mode of the terahertz wave camera system 400 in the period731 is an image capturing condition adjustment mode. In the period 731,the control units 103 and 424 set the image capturing condition of theillumination unit 101 and the detection unit 102 to a predeterminedcondition in accordance with the control sequence of the apparatusdescribed below.

The operation mode of the terahertz wave camera system 400 in the period732 is an object determination processing mode. In the period 732, theimage processing unit 105 makes a determination based on an image of theobject 106 captured under the image capturing condition set in theperiod 731. In the period 732, the image processing unit 105 determines,based on the determination result, an image capturing condition underwhich the actual image capturing of the terahertz wave camera system 400will be performed (also referred to as an “actual image capturingcondition”).

The operation mode of the terahertz wave camera system 400 in the period733 is an actual image capturing mode. In the period 733, the controlunits 103 and 424 perform control to perform the actual image capturingof the object 106 under the image capturing conditions determined in theperiods 731 and 732. The operation in the periods 731 and 732 may beperformed in the standby period of the terahertz wave camera system 400,and the operation in the period 733 may be performed in the imagecapturing period of the terahertz wave camera system 400.

The detailed flow will be described below. If the operation of theterahertz wave camera system 400 starts, then in step S701, theoperation proceeds to the period 731. In the period 731, in step S702,the control units 103 and 424 control the components of the terahertzwave camera system 400 based on the control sequence under a condition734. In the present exemplary embodiment, the control unit 103 controlsthe operation of the illumination unit 101, and the control unit 424controls the operation of the detection unit 102. More specifically, thecontrol unit 103 controls the terahertz wave 107 a output from thetransmission unit 101 a and the terahertz wave 107 b output from thetransmission unit 101 b. The control unit 424 controls the output ofimage data from the reception unit 102 a and the output of image datafrom the reception unit 102 b. Here, an example is described where thecontrol unit 103 controls the transmission units 101 a and 101 b andcontrols the terahertz waves 107 a and 107 b emitted from thetransmission units 101 a and 101 b, respectively, and the control unit424 controls the reception units 102 a and 102 b and controls theoutputs of the pieces of image data from the reception units 102 a and102 b. The control targets of the control units 103 and 424, however,are not limited to these. The control unit 424 may control only thesingle reception unit 102 a and control the output of the image datafrom the reception unit 102 a. The control unit 424 may further controlthe reception units 102 c and 102 d and control the outputs of pieces ofimage data from the reception units 102 c and 102 d. The control unit103 is similar to that in the first exemplary embodiment, and thus isnot described. In the control sequence under the condition 734, aplurality of image capturing conditions and the order of carrying outthe image capturing conditions are stored. The control units 103 and 424control terahertz waves emitted from the illumination unit 101 and theoutputs of pieces of image data from the detection unit 102 based on theimage capturing condition for the control sequence. For example, in thecontrol sequence under the condition 734, the combinations and the orderof the terahertz waves 107 a to 107 d emitted from the transmissionunits 101 a to 101 d, respectively, and the combinations and the orderof the reception units 102 a to 102 d are stored.

In the period 731 in step S703, the detection unit 102 measures theterahertz waves 108 a and 108 b. The terahertz wave camera system 400acquires image data 735 including either or both of the pieces of imagedata output from the reception units 102 a and 102 b. In the case ofFIG. 4, image data including any of the pieces of image data output fromthe reception units 102 a to 102 d, or any combination of the pieces ofimage data, or all of the pieces of image data is output. The imageprocessing unit 105 converts the image data 735 into the terahertz image943 illustrated in FIG. 9.

After the image data 735 is acquired, then in step S704, the operationproceeds to the period 732. In the period 732, an image capturingcondition to be applied in the period 733 (an actual image capturingcondition) to which the operation will proceed is determined based onthe acquired image data 735. The image capturing condition to be used inthis actual image capturing is referred to as a “condition 737”. In thecondition 737, control information regarding the terahertz wave 107 a ofthe transmission unit 101 a, control information regarding the terahertzwave 107 b of the transmission unit 101 b, control information regardingthe image data about the reception unit 102 a, and control informationregarding the image data about the reception unit 102 b that are to beused in the period 733 are recorded. Further, control informationregarding another transmission unit or another reception unit can alsobe recorded. The condition 737 is determined by the image processingunit 105 based on the determination of the image processing unit 105described below. The detailed operation flow in the period 732 will bedescribed below.

In step S705, the image processing unit 105 extracts a similarity or acorrelation. Next, in step S706, using the result of the extraction, theobject 106 is determined. If it is determined that the object 106includes the concealed object 106 a (YES in step S706), then in stepS707, the image capturing condition of the illumination unit 101 and thedetection unit 102 used in the control sequence under the condition 734is recorded as the condition 737 (the actual image capturing condition).In step S708, it is checked whether the control sequence under thecondition 734 ends. If the control sequence does not end (NO in stepS708), the operation returns to the period 731. If the control sequenceends (YES in step S708), then in step S709, the operation proceeds tothe actual image capturing mode in the period 733. The processes ofsteps S705 to S709 are similar to those of steps S505 to S509 in thefirst exemplary embodiment, and thus are not described in detail.

In the period 733, under the image capturing conditions determined inthe periods 731 and 732, the actual image capturing of the object 106 isperformed. In step S710, based on the condition 737, the control units103 and 424 control the illumination unit 101 and the detection unit102. On the basis of the actual image capturing condition as thecondition 537, the control unit 103 controls the operations of thetransmission units 101 a and 101 b and controls the terahertz waves 107a and 107 b emitted from the transmission units 101 a and 101 b,respectively. The control unit 424 controls the operations of thereception units 102 a and 102 b and controls the outputs of the piecesof image data. For example, only a terahertz wave contributing to theobservation of the concealed object 106 a is brought into the emissionstate, and the output of image data contributing to the observation ofthe concealed object 106 a is started. To take the models in FIGS. 10Band 11 as examples, the transmission unit 101 a that emits the terahertzwave 107 a to become the reflected terahertz wave 108 a contributing tothe observation of the concealed object 106 a is brought into theemission state. The reception unit 102 a that receives the reflectedterahertz wave 108 a contributing to the observation of the concealedobject 106 a is controlled to output the image data.

The control units 103 and 424 perform control as in step S710, so that,in step S711, the terahertz wave camera system 400 can acquire aterahertz image with reduced noise. The capturing of an image under suchan image capturing condition reduces an unwanted reflected terahertzwave regarding the covering object 106 b. This facilitates theacquisition of an image regarding the concealed object 106 a withinformation regarding the covering object 106 b reduced. While notdescribed in the present exemplary embodiment, also in a case where theconcealed object 106 a is specified after this, it is easy to specifythe concealed object 106 a.

In the present exemplary embodiment, the control units 103 and 424 maynot be physically two units. Further, the control units 103 and 424 andthe image processing unit 105 may be a physically single unit.

Fourth Exemplary Embodiment

Referring now to FIG. 8, a terahertz wave camera system 800 according toa fourth exemplary embodiment will be described. In the description ofthe present exemplary embodiment, portions similar to those in otherexemplary embodiments are not described.

FIG. 8 is a diagram illustrating the configuration of the terahertz wavecamera system 800 according to the present exemplary embodiment. Theterahertz wave camera system 800 includes at least an illumination unit101, a detection unit 102, a control unit 424, and an image processingunit 105. The terahertz wave camera system 800 further includes avisible camera 109. These components are similar to those in otherexemplary embodiments, and therefore are not described.

In the terahertz wave camera system 800 according to the presentexemplary embodiment, the illumination unit 101 includes a singletransmission unit 101 a, and does not include the control unit 103. Thecamera system 100 according to the first exemplary embodiment controlsthe operation of the illumination unit 101, and the camera system 400according to the third exemplary embodiment controls the operations ofboth the illumination unit 101 and the detection unit 102. The camerasystem 800 according to the present exemplary embodiment controls theoperation of the detection unit 102. The operation of the control unit424 and the flow of the camera system 800 according to the presentexemplary embodiment are similar to the operation of the control unit424 and the flow of the camera system 400 according to the thirdexemplary embodiment.

In this manner, an appropriate adjustment of the operation of at leastone of the illumination unit 101 or the detection unit 102 enables noiseof a terahertz image to be reduced.

Fifth Exemplary Embodiment

FIGS. 14A and 14B are diagrams illustrating a learning phase and anestimation phase, respectively, of an AI unit that makes a determinationin a terahertz wave camera system according to a fifth exemplaryembodiment. In this example, a case will be described where a concealedobject is determined. FIG. 14A is a conceptual diagram of the learningphase. A learning model 1410 has a shape determination algorithm.Supervised data is input to the learning model 1410. The supervised datais, for example, concealed object images 1402. Additionally, dependingon the determination, terahertz images, such as covering object images1401 and covering object and concealed object images 1403 can also beused as the supervised data. The covering object images 1401 include aplurality of terahertz images obtained by capturing different coveringobjects. The covering object images 1401 include a plurality ofterahertz images obtained by capturing a covering object through theoperations of different illumination units 101. The concealed objectimages 1402 include a plurality of terahertz images obtained bycapturing different concealed objects. The concealed object images 1402include a plurality of terahertz images obtained by capturing aconcealed object through the operations of different illumination units101. The concealed object images 1402 include an image (shape data)indicating the contour of a concealed object. The covering object andconcealed object images 1403 include a plurality of terahertz imagesobtained by capturing different covering objects and concealed objects.The covering object and concealed object images 1403 include a pluralityof terahertz images obtained by capturing a covering object and aconcealed object through the operations of different illumination units101. For example, the covering object images 1401, the concealed objectimages 1402, and the covering object and concealed object images 1403may include visible light images. Labels are assigned to the imagesincluded in the covering object images 1401, the concealed object images1402, and the covering object and concealed object image 1403. Thesupervised data is input, so that a trained model 1411 with higheraccuracy than the algorithm of the learning model 1410 is generated.

As the specific algorithm of machine learning, a nearest neighboralgorithm, a Naive Bayes algorithm, a decision tree, or a support-vectormachine may be used. Alternatively, deep learning may be used in whichAI itself generates a feature amount for learning and a connectionweight coefficient, using a neural network. For example, as a model ofdeep learning, a convolutional neural network (CNN) model may be used.

FIG. 14B is a conceptual diagram of the estimation phase. If a capturedterahertz image 1420 is input to the trained model 1411 constructed inthe learning phase, a result of specifying a concealed object is outputfrom the trained model 1411. The terahertz image 1420 is, for example,an image based on the image data acquired in step S1202 in FIG. 12A. Theprocessing using the trained model 1411 can be executed by, for example,the image processing unit 105 in FIG. 1.

Sixth Exemplary Embodiment

In a sixth exemplary embodiment, with reference to FIG. 15, adescription will be given of another operation flow of the terahertzwave camera system 100 described in the first exemplary embodiment. Inthe description of the present exemplary embodiment, portions similar tothose in other exemplary embodiments are not described.

A terahertz wave camera system 100 according to the present exemplaryembodiment has the configuration illustrated in FIG. 1. The terahertzwave camera system 100 may or may not include the visible camera 109.

Depending on the surface shape of an object, a change in the angle ofthe surface of the object is complicated and differs with respect toeach object. Accordingly, with respect to each object, the suitablepositional relationship between an illumination unit serving as a lightsource and a detection unit may change. In a case where the objectmoves, the positional relationship between the illumination unit servingas the light source and the detection unit may change moment by moment.Depending on such a change in the positional relationship, an unwantedreflected terahertz wave among terahertz waves reflected from the objectmay be detected. In such a case, an image is obtained on which thecomponent of the unwanted reflected terahertz wave is superimposed andwhich has a large amount of noise.

FIG. 15 is a flowchart illustrating the operation flow according to thepresent exemplary embodiment. The present exemplary embodiment ischaracterized by the operation method of the illumination unit 101. Theoperation of the illumination unit 101 is controlled by the control unit103. The illumination unit 101 sequentially lights up the transmissionunits 101 a to 101 d, and an image is captured with respect to each ofthe transmission units 101 a to 101 d. The flow in FIG. 15 illustratesthe operation in the image capturing period. In the initial state, thetransmission units 101 a to 101 d are off.

In step S1501, the transmission unit 101 a is turned on. In step S1502,the reception unit 102 detects a signal based on the terahertz wave 107a from the transmission unit 101 a. In step S1503, the transmission unit101 a is turned off. In steps S1501 and S1502, an image based on theterahertz wave 107 a from the transmission unit 101 a can be acquired.Next, in step S1504, the transmission unit 101 b is turned on. In stepS1505, the reception unit 102 detects a signal based on the terahertzwave 107 b from the transmission unit 101 b. In step S1506, thetransmission unit 101 b is turned off. In steps S1504 and S1505, animage based on the terahertz wave 107 b from the transmission unit 101 bcan be acquired. Next, in step S1507, the transmission unit 101 c isturned on. In step S1508, the reception unit 102 detects a signal basedon the terahertz wave 107 c from the transmission unit 101 c. In stepS1509, the transmission unit 101 c is turned off. In steps S1507 andS1508, an image based on the terahertz wave 107 c from the transmissionunit 101 c can be acquired. In step S1510, the transmission unit 101 dis turned on. In step S1511, the reception unit 102 detects a signalbased on the terahertz wave 107 d from the transmission unit 101 d. Instep S1512, the transmission unit 101 d is turned off. In steps S1510and S1511, an image based on the terahertz wave 107 d from thetransmission unit 101 d can be acquired.

As described above, the plurality of the transmission units 101 a to 101d is sequentially turned on, thus facilitating selection and acquisitionof a suitable image that does not depend on the surface shape of theobject. This is suitable, in particular, for a case where the objectmoves.

The transmission units 101 a to 101 d are controlled by the control unit103. The control unit 103 can select a plurality of operations. Theplurality of operations includes at least an operation for turning onthe transmission unit 101 a and turning off the transmission units 101 bto 101 d, and an operation for turning on the transmission unit 101 band turning off the transmission units 101 a, 101 c, and 101 d. Theplurality of operations includes at least an operation for turning onthe transmission unit 101 c and turning off the transmission units 101a, 101 b, and 101 d, and an operation for turning on the transmissionunit 101 d and turning off the transmission units 101 a to 101 c.

While the operation flow illustrated in FIG. 15 is performed, a suitableimage capturing condition may be determined as illustrated in FIG. 5. Inother words, in the period 531 in the operation flow in FIG. 5, theoperation flow in FIG. 15 may be performed, and an image capturingcondition may be extracted from at least four images. That is, after theoperation flow in FIG. 15, a determination may be made, and the imagecapturing condition may be extracted. The determination may be made by,in addition to the detection of the shape or the type of the object,selecting an image in which a noise component does not exceed aprescribed value, or comparing noise components and selecting an imageincluding the smallest noise component. The object may be captured usingthe extracted image capturing condition. The image capturing conditionis extracted, for example, when the orientation of the object changes bya greater amount than a reference. A mode may be employed in which theimage capturing condition is periodically extracted at time intervalsdetermined in advance, and the image capturing condition is updated.

In the present exemplary embodiment, the transmission units 101 a to 101d are sequentially lit up. The aspect of the embodiments, however, isnot limited to this. For example, the transmission units 101 a and 101 bare simultaneously turned on, the reception unit 102 detects signals,and the transmission units 101 a and 101 b are turned off. Then, thetransmission units 101 c and 101 d are simultaneously turned on, thereception unit 102 detects signals, and the transmission units 101 c and101 d are turned off.

The transmission units 101 a to 101 d are disposed along any singledirection as illustrated in FIG. 1. The aspect of the embodiments can beapplied to such a plurality of transmission units disposed along asingle direction. The aspect of the embodiments is applicable to aplurality of transmission units not only disposed along a singledirection but also disposed across a path. The transmission units 101 ato 101 d sequentially perform the operations of switching to the onstates along the arrangement direction, but these operations may notneed to be performed in order along the arrangement direction, and theorder of the operations can be appropriately changed.

The operation flow according to the present exemplary embodiment canalso be changed as follows. The operations of turning off thetransmission units 101 a to 101 c illustrated in steps S1503, S1506, andS1509 may be performed simultaneously with the operations of turning onthe transmission units 101 b to 101 d illustrated in steps S1504, S1507,and S1510, respectively.

The terahertz wave camera system according to the disclosure is notlimited to the configurations of the above exemplary embodiments. Forexample, the terahertz wave camera system may not include a visiblecamera, and a control unit may be provided outside the system. Forexample, the control units 103 and 424 and the image processing unit 105may be a physically integrated component, and the physically integratedcomponent may be stored in a server provided on a network. In the aboveexemplary embodiments, attention is paid to a covering object and aconcealed object. Alternatively, reflection on the skin surface of ahuman body can also be taken into account. The terahertz wave camerasystem according to the aspect of the embodiments can be applied to notonly a security gate but also any places, such as stairs, an escalator,an elevator, and a walk-through passage. The configurations described inthe exemplary embodiments can be appropriately combined together.According to the configuration of the aspect of the embodiments, it ispossible to acquire a terahertz image with reduced noise.

While the disclosure has been described with reference to exemplaryembodiments, it is to be understood that the disclosure is not limitedto the disclosed exemplary embodiments. The scope of the followingclaims is to be accorded the broadest interpretation so as to encompassall such modifications and equivalent structures and functions.

This application claims the benefit of Japanese Patent Application No.2020-021571, filed Feb. 12, 2020, and Japanese Patent Application No.2020-199354, filed Dec. 1, 2020 which are hereby incorporated byreference herein in their entirety.

What is claimed is:
 1. A system comprising: a first transmission unit configured to emit a first terahertz wave; a second transmission unit disposed at a position different from a position of the first transmission unit and configured to emit a second terahertz wave; a detection unit for detecting at least one of a first reflected terahertz wave that is a part of the first terahertz wave reflected from an object, or a second reflected terahertz wave that is a part of the second terahertz wave reflected from the object, and outputting image data based on the detected terahertz wave; and a first control unit configured to, under a condition set based on the image data, control at least one of an operation of the first transmission unit or an operation of the second transmission unit.
 2. The system according to claim 1, wherein the first control unit performs at least one of control for causing the first transmission unit to operate and stopping the second transmission unit, or control for stopping the first transmission unit and causing the second transmission unit to operate.
 3. The system according to claim 1, wherein the first control unit performs at least one of control for making an output of the first terahertz wave from the first transmission unit higher than an output of the second terahertz wave from the second transmission unit, or control for making the output of the first terahertz wave from the first transmission unit lower than the output of the second terahertz wave from the second transmission unit.
 4. The system according to claim 1, wherein the first control unit performs at least one of control for reducing a difference between an output of the first terahertz wave from the first transmission unit and an output of the second terahertz wave from the second transmission unit, or control for increasing the difference between the output of the first terahertz wave from the first transmission unit and the output of the second terahertz wave from the second transmission unit, or control for keeping constant the difference between the output of the first terahertz wave from the first transmission unit and the output of the second terahertz wave from the second transmission unit and changing the outputs of the first terahertz wave and the second terahertz wave.
 5. The system according to claim 1, wherein the system operates so as to include a first period in which the operations of the first transmission unit and the second transmission unit are controlled based on a first condition specifying control of the first transmission unit and the second transmission unit, a second period in which a second condition specifying control of the first transmission unit and the second transmission unit is created based on first image data output from the detection unit in the first period, and a third period in which, after the second period, the operations of the first transmission unit and the second transmission unit are controlled based on the second condition, and second image data output from the detection unit is acquired.
 6. The system according to claim 1, wherein the detection unit includes a first reception unit for detecting a terahertz wave, and a second reception unit disposed at a position different from a position of the first reception unit and for detecting a terahertz wave, and wherein the terahertz wave camera system further comprises a second control unit configured to control at least one of an operation of the first reception unit or an operation of the second reception unit.
 7. The system according to claim 6, wherein the second control unit performs at least one of control for causing an output of image data from the first reception unit to be performed and stopping an output of image data from the second reception unit, or control for stopping the output of the image data from the first reception unit and causing the output of the image data from the second reception unit to be performed.
 8. The system according to claim 6, wherein control for changing a signal gain for image data to be output from the first reception unit and a signal gain for image data to be output from the second reception unit is performed.
 9. The system according to claim 6, wherein the system operates so as to include a fourth period in which a third condition specifying control of the first transmission unit, the second transmission unit, the first reception unit, and the second reception unit is set, and the operations of the first transmission unit, the second transmission unit, the first reception unit, and the second reception unit are controlled based on the third condition, a fifth period in which, based on image data output from at least one of the first reception unit and the second reception unit in the fourth period, a fourth condition specifying control of the first transmission unit, the second transmission unit, the first reception unit, or the second reception unit is created, and a sixth period in which, after the fifth period, the operations of the first transmission unit, the second transmission unit, the first reception unit, and the second reception unit are controlled based on the fourth condition, and image data output from at least one of the first reception unit or the second reception unit is acquired.
 10. A system comprising: a first transmission unit configured to emit a first terahertz wave; a first reception unit configured to receive the first terahertz wave reflected from an object; a second reception unit disposed at a position different from a position of the first reception unit and configured to receive the first terahertz wave reflected from the object; and a second control unit configured to control at least one of an operation of the first reception unit or an operation of the second reception unit.
 11. The system according to claim 10, wherein the second control unit performs at least one of control for causing an output of the first reception unit to be performed and stopping an output of the second reception unit, or control for stopping the output of the first reception unit and causing the output of the second reception unit to be performed, or control for causing the output of the first reception unit and the output of the second reception unit to be performed.
 12. The system according to claim 10, wherein the second control unit performs at least one of control for making a gain for an output of the first reception unit higher than a gain for an output of the second reception unit, or control for making the gain for the output of the first reception unit lower than the gain for the output of the second reception unit, control for making the gain for the output of the first reception unit equal to the gain for the output of the second reception unit, or control for reducing a difference between the gain for the output of the first reception unit and the gain for the output of the second reception unit, or control for increasing the difference between the gain for the output of the first reception unit and the gain for the output of the second reception unit, or control for keeping constant the difference between the gain for the output of the first reception unit and the gain for the output of the second reception unit and changing the gain for the output of the first reception unit and the gain for the output of the second reception unit.
 13. The system according to claim 1, further comprising an image processing unit configured to generate a terahertz image based on the image data output from the detection unit and determine a shape of the object based on the terahertz image.
 14. The system according to claim 13, wherein the image processing unit includes a database configured to store model image information including shape data about the object.
 15. The system according to claim 13, wherein the image processing unit includes an artificial intelligence unit.
 16. The system according to claim 15, wherein the artificial intelligence unit has a deep learning function.
 17. The system according to claim 15, wherein the artificial intelligence unit includes a trained machine learning model, and wherein the machine learning model is constructed based on image information including shape data.
 18. The system according to claim 1, wherein the condition set based on the image data is an image capturing condition which is used when image data based on the first reflected terahertz wave and image data based on the second reflected terahertz wave are compared with each other and the image data having a smaller noise component is acquired.
 19. A system comprising: a first transmission unit configured to emit a first terahertz wave; a second transmission unit disposed at a position different from a position of the first transmission unit and configured to emit a second terahertz wave; a third transmission unit disposed at a position different from the positions of the first transmission unit and the second transmission unit and configured to emit a third terahertz wave; a detection unit for detecting at least any one of a first reflected terahertz wave that is a part of the first terahertz wave reflected from an object, a second reflected terahertz wave that is a part of the second terahertz wave reflected from the object, or a third reflected terahertz wave that is a part of the third terahertz wave reflected from the object, and outputting image data based on the detected terahertz wave; and a first control unit for selecting a first operation for turning on the first transmission unit and turning off the second transmission unit and the third transmission unit, a second operation for turning on the second transmission unit and turning off the first transmission unit and the third transmission unit, and a third operation for turning on the third transmission unit and turning off the first transmission unit and the second transmission unit.
 20. A method for controlling a system comprising a first transmission unit for emitting a first terahertz wave, a second transmission unit disposed at a position different from a position of the first transmission unit and for emitting a second terahertz wave, and a detection unit for detecting at least one of a first reflected terahertz wave that is a part of the first terahertz wave reflected from an object, and a second reflected terahertz wave that is a part of the second terahertz wave reflected from the object, and outputting image data based on the detected terahertz wave, the method comprising, controlling at least one of an operation of the first transmission unit or an operation of the second transmission unit based on the image data output from the detection unit.
 21. The system according to claim 1, further comprising a processing unit configured to generate an image from the image data.
 22. The system according to claim 1, further comprising a camera configured to detect a wave different from the detected terahertz wave.
 23. The system according to claim 10, further comprising a processing unit configured to generate an image from the image data.
 24. The system according to claim 10, further comprising a camera configured to detect a wave different from the detected terahertz wave.
 25. The system according to claim 19, further comprising a processing unit configured to generate an image from the image data.
 26. The system according to claim 19, further comprising a camera configured to detect a wave different from the detected terahertz wave.
 27. The method according to claim 20, wherein the system further comprises a processing unit configured to generate an image from the image data.
 28. The method according to claim 20, wherein the system further comprises a camera configured to detect a wave different from the detected terahertz wave. 